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I. INTRODUCTION 



The research reported in this paper was carried out as 
part o£ a larger study at the Naval Postgraduate School (NPS) 
during 1973 and 1974. The goal of the NPS study was to de- 
velop methods for selecting U.S. Navy officers for graduate 
education who would do well academically and be satisfied 
with the material they studied and want to be assigned to 
jobs utilizing their education. This paper describes re- 
search conducted at NPS which used the Strong Vocational 
Interest Blank (SVIB) as a predictor of both academic grades 
and satisfaction with graduate education. 
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II. BACKGROUND 



The U.S. Navy and the other U.S. services plus the armed 
forces of many allies spend millions of dollars every year 
on the graduate education of their officers . In recent 
times, about 570 Navy officers a year have received Navy 
funded graduate degrees at NFS. (Cong. Record, 1973, p. 

617.) The justification for these expenditures for graduate 
education has been that certain Navy officer billets require 
the incumbent to have such an education in order to perform 
optimally in the job. As a matter of fact, the identifica- 
tion and description of such billets is used to determine 
how many officers are required with Masters degrees in any 
given area, e.g., physics or financial management. Given 
these derived minimum educational needs, the U.S. Navy's 
Bureau of Personnel (BuPers) , selects officers for graduate 
education programs at NPS and civilian universities. The 
officers and BuPers expect, and hope, that all officer/stu- 
dents will successfully complete their program and attain 
their graduate degree. The officer probably also hopes that 
he will enjoy his studies; BuPers and the rest of the Navy 
should hope that the officer will desire to use his education 
in his later jobs, as that is how the officer's education 
will pay off in terms of the Navy's effectiveness. The best 
payoff to the Navy comes, then, when the officer does well in 
studies that he enjoys. The remainder of this investigation 
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focuses on research concerning the prediction of academic 
performance and satisfaction. 
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III. THE STRONG VOCATIONAL INTEREST BLANK 



The Strong Vocational Interest Blank (SVIB) has been 
used in counseling and selection concerning civilian sector 
occupations for over 40 years in the United States. The 
SVIB was developed by contrasting responses to items (ex- 
pressions of "Like," "Indifferent," or "Dislike" to items 
addressing activities, hobbies, reading materials, etc.) or 
people in an occupation with Men in General (MIG) . The dis- 
criminating power of the responses to an item are expressed 
in terms of unit weights, e.g., L = 1, I = 0, D = -1, or, 

L= -1, I = 0, D= +1. The items differentiating between 
the occupation and the MIG group are then considered as 
forming a key for that occupation. An individual can then 
be scored using this key and his score compared with indi- 
viduals in that occupation. 

E. K. Strong, Jr. (Tyler, 1965, p. 193) put forth four 
propositions concerning the SVIB. 

1. Men continuing in occupation A obtain a higher in- 
terest score in A than in any other occupation. 

2. Men continuing in occupation A obtain a higher 
score in A than men entering other occupations. 

3. Men continuing in A obtain higher scores in A than 
men who change from A to another occupation. 

4. Men changing from A to B score higher in B prior to 
the change than in any other occupation including A. 
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Over the last forty years or so, these four propositions have 
been rather well corroborated (Tyler, 1965, p. 193). 

The longitudinal stability of SVIB scores is also im- 
pressive. Over 22 year intervals, the correlations among 
individuals’ occupational interest scores are around .80 
and higher (Strong, 1951, p. 89-91). The stability of in- 
terest scores is influenced by two major factors (Tyler, 

1965, p. 190) , 

1. Age when the SVIB was first taken. 

2. The interval of time between the test and retest. 

These two factors seem to be equally important in determining 
the similarity between test and retest SVIB occupational 
scores (Tyler, 1965, p. 189). 

In U.S. Navy research using the SVIB, positive results 
have been obtained in predicting Naval Academy disenrollments 
(Abrahams and Neumann, 197^, NROTC disenrollments (Abrahams 
and Neumann, 1971), and in selecting NESEP men (Abrahams and 
Neumann, 1971), and Navy recruiters (Abrahams, Neumann and 
Rimlard, 1973 and Abrahams and Neumann, 1974) . 

Several recent studies of the use of the Strong Vocation- 
al Interest Blank (SVIB) in prediction of academic achieve- 
ment offer evidence as to the effectiveness of this instrument 
for that purpose. Most of the studies relate to undergraduate 
academic achievement as measured by grade point average (GPA) . 

These studies can generally be divided into two classes, 
those using the non- vocational scales (primarily the Academic 
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Achievement scale) as predictors and those relating the vo- 
cational scales to scholastic performance. 

Hauntras, Lee and Hebahlran present a step-wise regres- 
sion, with grade point average as the dependent variable, 
using all of the occupational scales. The sample of 423 
male freshmen were divided into the six Holland classes 
(Realistic, Intellectual, Artistic, Conventional, Social 
and Enterprising) using the Holland Vocational Interest 
Blank Scores. For the entire sample the Strong Academic 
Achievement (AACH) score was the best predictor (r = .374), 
as it was for the Realistic Orientation group (r = .365), 
the Intellectual Orientation group (r = .420) and the 
Artistic Orientation group (r = ,303). All but the Artis- 
tic group coefficients were significant at the ,01 level, 
which was significant at the .05 level. The Occupational 
Level scale was the best predictor for the Conventionally 
Oriented (N = 412), with AACH the second best predictor. 

Johnson analyzed the SVIB results for 290 art/science 
and 98 business administration freshmen utilizing the Rust 
and Ryan achievement scales, the Martin AIS scales, the 
Self-rating Scale and the AACH scale. Johnson also calcu- 
lated a Predicted Achievement Score based on a combination 
of high school rank and the Scholastic Aptitude Test score. 
These correlations are summarized on page 12, 

Campbell and Johansson in the original validation studies 
for the Academic Achievement scale (AACH) report a correla- 
tion between men's AACH score and GPA of .52 for a group of 
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Scale/Test 


Art/Science 


Bus, Ad. 


Both 


Rust -Ryan 


-.18 


.01 


.01 


AIS - short 


.12 


.14 


.06 


AIS - long 


.09 


- .08 


.08 


Self-Rating 


.00 


.12 


.05 


HS rank 8 
SAT score 


.19* 


. 32* 


.24* 


AACH 


.17** 


.02 


00 


*p = .01 








**p = .05 









Minnesota freshmen, however for the freshmen cross validation 
group the coefficient dropped to .36. For another cross 
validation group made up of a twenty-five year follow-up 
sample, Campbell obtained a .35 correlation with grades. 

Using attained educational level for this latter sample an 
AACH mean score of 58 was found for PhD recipients, 52 for 
MA recipients, 47 for BA recipients, and 42 for those who 
obtained no degree. Almost a full standard deviation sepa- 
rated the PhD and the BA recipients. It is difficult to 
say, however, whether higher degrees reflect an AACH interest 
or if those vv/ith higher degrees develop a greater AACH in- 
terest. Increase in scores during the four college years 
suggest the latter explanation. 

Lindsay and Althouse concluded that the AACH is not 
better than aptitude measures and past performance in pre- 
dicting academic performance. For a sample of first-year 
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male students at Penn State the following correlations with, 
grade point average were produced: AACH .10, SAT verbal 

.19, SAT math .09 and high school GPA .38. For women the 
coefficients were .25, .48, .15 and .29 respectively. In a 
multiple correlation analysis, when AACH was added to the 
SAT score and grade point average, multiple R was raised 
only from .5177 to .5289. 

At Illinois, Wagman found a correlation between grades 
and AACH of .35 for 193 graduate and undergraduate students. 
By comparison, the correlation between the Student College 
Aptitude Test and the grades was .39. 

In a study relating persistance to pursue an engineering 
curriculum to occupational interests, Taylor and Hanson di- 
vided engineering and former engineering students into four 
groups: (1) the academically successful who remained in the 

engineering program; (2) the successful students who trans- 
ferred out of engineering; (3) unsuccessful students who 
dropped out, and, (4) unsuccessful students who stayed in 
engineering. Higher scores were achieved by successful en- 
gineers than successful transfers in the following occupa- 
tional interests: Carpenter, Printer, Farmer, Math . -Science 

Teacher, and Veterinarian. The persistors had lower scores 
than the transfers for Personnel Director, Social Science 
Teacher, School Superintendent, Life Insurance Salesman, 
Advertising, Lawyer and Journalist. The academically inade- 
quate who dropped out differ from the successful persistors 
in that they achieved higher scores for Mortician and Social 
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Science Teacher, and lower scores for Chemist and Psycholo- 
gist. The transfers had higher scores than those in the 
other three classifications for Personnel Director, School 
Superintendent, Advertising, Lawyer, Journalist, Political 
Scientist, Sociologist and Occupational Level and lower in 
Farmer, Math . -Science Teacher, Veterinarian, Printer and 
the Mechanical score. The two groups of persistors scored 
higher than the withdrawers in Phychologist and Academic 
Achievement. Persistors made higher grades in Science than 
the non-persistors , and, regardless of their grades, those 
students with interest in solving math and science problems 
stayed in the engineering curriculum. 

A 1969 study at NPS by Fernald, et . at 3 found high re- 
lationships between SVIB occupational scales and grade point 
averages using multiple regression methods. Unfortunately, 
they did not cross validate their equations, and, as they 
had used step-wise multiple regression procedures, it was 
impossible to estimate how much the obtained multiple cor- 
relations would shrink in a new sample (Thorndike, p. 205). 
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IV. PROCEDURE 



During fiscal year 1974, officer/students in a number of 
curricula at NPS were administered the SVIB. The curricula 
and numbers of individuals sampled are given in Table I. 



Table I. 

Curricula and Numbers of Officer/Students 
in the SVIB Sample 



Curriculum Number of Officer/Students Taking SVIB 



360 OpsRes . /SysAnal , 80 

367 CompSysMgt. 48 

368 Comp. Science , 24 

610 AeroEng. 103 

620 ComMgt. 42 

816 SysAcqMgt. • 52 

817 Mgt. 130 

479 



The officer/students in these curricula range from ensign 
to Commander in military rank and from about 22 to 40 in age. 
The Navy officers included in the sample were chaplains, 
pilots, surface ship officers, submariners, engineering duty 
officers, and supply officers. 

Following the collection of the SVIB answer sheets, the 
forms were sent to the Navy Personnel Research and Develop- 
ment Center (NPRDC) in San Diego, California, where the in- 
dividuals' responses were processed and scored. Each 
officer/student was scored in terms of the similarity between 
his responses to the SVIB and the responses of individuals 
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in each of 56 occupations.^ An average score for each of the 
curricula was also computed on each of the SVIB's occupation- 
al scales. These averages are contained in Appendix A. A 
master magnetic tape was also developed at the NPRDC contain- 
ing each individuals responses to each of the 399 items in 
the SVIB. (These item response data were used later in at- 
tempts to construct SVIB scales predictive of grade average 
and satisfaction.) 

Because of the relatively small number of officer/students 
in each of the curricula, and because some of the intended 
data analyses would require samples larger than could be 
obtained from any single curriculum, an investigation was 
conducted to determine if the SVIB data from some curricula 
could be aggregated. In this analysis, correlations were 
computed among the curricula based upon their scores on the 
56 occupational keys. Table II shows the correlations that 
were obtained. 

The correlations in Table II indicate that all of the 
management curricula tended to have fairly similar SVIB 
profiles with one another, and that the SVIB occupational 
scores from the OR/SA curriculum tended to be more similar 
to those from the management curricula than to those from 
CS or Aero curricula. Further, the CS and Aero curricula 
SVIB scores tend to be more similar to one another than they 



For a further description and explanation, Campbell, 
D. P., Handbook for the Strong Vocational Interest Blank , 
S t an f o rd University Press, 1971 . 
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do to any of the other curricula. Based upon these correla- 
tions, the data from the management (#367, #620, #816, and 
#817) and OR/SA (#360) curricula were aggregated, while those 
from CS (#368) and Aero Eng. (#610) were placed together in 
another set. 



Table II. 



Intercorrelations Among SVIB Occupational 
Scores for Seven Curricula 

Curricula 





1 


2 


3 


4 


5 


6 


7 


1 


1.00 


.87 


.77 


.93 


.84 


.77 


.84 


2 




1.00 


.96 


.88 


.77 


.64 


.83 


3 






1.00 


.78 


.67 


.49 


. 76 


4 








1.00 


.91 


.85 


.91 


5 










1.00 


.90 


.94 


6 












1.00 


.86 


7 














1.00 



1 = ComMgt. 

2 = AeroEng. 

3 = Comp. Science 

4 = SysAcqMgt. 

5 = CompSysMgt. 

6 = Mgt . 

7 = OR/SA 



For data analysis purposes, developmental and cross valida- 
tion groups were then formed. Table III displays the curricula 
and the numbers of officer/students in the various developmen- 
tal and cross validation groups. 

A. PRELIMINARY ANALYSES 

As grades (TQPR's) and satisfaction were to be used as the 
criteria in this research, it was necessary to measure and 
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Table III. 



Sizes of the Developmental and Cross val idation Groups 
Used in the Analyses of SVIB Occupational Scores as 
Predictors of Academic Grades and Satisfaction 



Management 


Developmental 


Cross val idation 


Total 


817 Mgt. 


73 


20 


93 


620 ComMgt . 


30 


12 


42 


816 SAM 


37 


15 


52 


367 CSM 


35 


11 


48 


Total 


175 


60 


235 


CS/Aero 


368 CS 


‘16 


7 


23 


610 Aero 






89 


. Total 


76 


36 


112 


OR/SA 


360 OR/SA 


50 


21 


71 


Grand Totals 


301 ' 


117 


418 



understand these variables . This section describes how the 
criteria data were developed and processed prior to their 
use with the data from the SVIB. 

1 . Grades 

Each of the officer/students in the sample (except 
for those in Aeronautical Engineering) reported his grade 
average in his graduate curriculum at NPS. This numerical 
average would fall on the following scale: 

Grade Numerical Value 



A - 4.0 

B 3.0 

C 2.0 

D 1.0 

Failing 0 
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The Aeronautical Engineering curriculum presented a 
unique problem, however, as officer/students in that curricu- 
lum had been graded on a different system. For the purposes 
of this study, grades from Aero were treated as follows: 

Aero Grade System NFS Grade Equivalent Numerical Value 

H A 4 

G B 3 

S C 2 

The grades for Aero Eng. students were computed by the 
author of this thesis based upon records available in the Aero 
Eng. curriculum office. 

After each of the officer/students in the sample had 
reported or been assigned a TQPR, preliminary investigation 
of these data were launched. The first question to be an- 
swered concerned the validity of reported TQPR's. 

The NPS academic transcripts of 55 Management stu- 
dents (Curriculum #817) were retrieved and the students' com- 
puted TQPR's compared with their self-reported TQPR's. The 
correlation between the reported and actual TQPR's was .99, 
and the means were 3.37 and 3.34, respectively. The NPS 
academic transcripts of all 42 U.S.N. students in Communica- 
tions Management (Curriculum #620) were also obtained, and 
their actual TQPR's compared with their self-reported TQPR's. 

In all 42 cases, their actual and self-reported TQPR's were 
identical. It seemed obvious that self-reported TQPR's pro- 
vided rather accurate estimates of actual TQPR's. Hence, 
most of the analyses reported in this study will utilize 
self-reported TQPR. 
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The second study o£ TQPR’s investigated the longi- 
tudinal stability of individuals’ TQPR's. This investiga- 
tion was important for two major reasons. First, if grades 
are quite unstable over time, i.e., the ordering of students 
according to TQPR’s changes from quarter to quarter, then 
different variables would likely be important in predicting 
TQPR’s in different quarters of a curriculum. -This would 
have introduced added complexities to this study, although 
the prediction of TQPR in the final quarter of the curricu- 
lum would still have been of paramount importance. (Though 
the researcher would have to remember that some officers may 
have been removed from the curriculum due to low grades in 
earlier quarters, and this may have been due to low abilities 
in areas, e.g., verbal, not required in the later quarters 
of the curriculum.) 

The second reason for the importance of the grade 
stability study stemmed from the relatively small sample sizes 
in the different curricula. The set of students in a curricu- 
lum consisted of two or more subsets of students that had 
been in the curriculum different lengths of time. In Aero 
Eng., for example, there were student groups that had been 
in the curriculum 1, 3, 5, 7, or 9 quarters. If TQPR’s were 
stable over time, then TQPR data from students who had fin- 
ished only a few quarters could be considered as indicative 
of what their TQPR’s (or at least their relative standing on 
TQPR when compared with their peers) would be after they had 
completed their curriculum. And if TQPR's after a few quarters 
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could be considered as indicative o£ later TQPR's, then the 
subsets o£ students who had been in the curriculum di££erent 
amounts o£ time could be merged and used in later statistical 
analyses examining the SVIB as a predictor o£ TQPR. 

The £irst analysis o£ TQPR stability was a longi- 
tudinal study o£ the stability o£ grades in the Operations 
Research/Systems Analysis, Management, and Aeronautical En- 
gineering curricula. 

An examination o£ students' records in the Operations 
Research/Systems Analysis curriculum o££ice revealed that 
25 U.S. Navy o££icers were currently enrolled in their 
seventh quarter o£ that curriculum. This is the same number 
o£ o££icers who had enrolled in the curriculum over six 
quarters previously. Hence, no U.S. Navy o££icers in that 
input to the OR/SA curriculum had been lost. Each o£ the 25 
o££icers' TQPR's was computed at the end o£ each o£ the six 
quarters that had been completed. Intercorrelations among 
the six sets o£ TQPR's were then calculated. These correla- 
tions are shoim in Table IV. 



Table IV. 



Correlations Among TQPRs A£ter Completion o£ Di££erent 
Numbers o£ Quarters o£ the OR/SA 
Curriculum (N = 25 U.S.N. 0££icers) 

Quarters Completed^ 



Quarters ^ 
Completed"^ 



1 


2 


3 


4 


5 


6 


1 1.00 


.95 


.92 


.92 


.90 


.89 


2 


1.00 


.98 


.97 


.96 


.95 


3 




1.00 


.99 


.98 


.97 


4 






1.00 


.99 


.99 


5 








1.00 


1.00 


6 










1.00 



Each quarter is 12 weeks in length, 
21 
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As TQPR is a cumulative average, the correlations 
among TQPR's from different quarters are part-whole correla- 
tions. One would therefore expect fairly high intercorrela- 
tions among TQPR's from successive quarters, but the 
magnitudes of the correlations in Table IV are surprisingly 
high. Particularly surprising are the intercorrelations be- 
tween TQPR after one quarter with the TQPR's after five 
(r = .90) or six quarters (r = .89). All in all, the data 
in Table IV indicate that TQPR's after two or three quarters 
in a curriculum are quite predictive of TQPR's after six 
quarters . 

Students ' grade records were also gathered from the 
Aeronautical Engineering and the Management curricular of- 
fices. A TQPR was computed for each student at the end of 
each of the quarters he had completed. The intercorrelations 
among these TQPR's are shown in Tables V and VI. 



Table V. 

Correlations Among TQPRs After Completion of 
Different Numbers of Quarters of the Aero Eng. 
Curriculum (N = 24 U.S.N. Officers) 

Quarters Completed ^ 



1 2 



3 



7 



Quarters, 1 1.00 .94 

Completed"^ 2 1.00 

3 
7 



.93 


.87 


.98 


.90 


1.00 


.92 




1.00 



1. Each quarter is 12 weeks in length. 
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Table VI. 



Correlations Among TQPRs After Completion of 
Different Numbers of Quarters of the Management 
(#817) Curriculum (N = 33 U.S.N. Officers) 







Quarters Completed^ 










1.2 3 


4 


5 




1 


1.00 .87 .85 


. 83 


.78 


Quarters ^ 
Completed'*' 


2 

3 

4 


1.00 .98 

1.00 


.96 

.98 

1.00 


.93 

.94 

.97 




5 






1.00 






1. Each quarters is 12 


weeks 


in length 



The pattern of correlations in Tables V and VI is 
much like that displayed for the OR/SA curriculum in Table 
IV: After two or three quarters in his curriculum, an of- 

ficer/students' TQPR after five or more quarters can be 
readily predicted. More specifically, an individual's stand- 
ing in the distribution of TQPR's after five or more quarters 
can be predicted from his TQPR after two or three quarters. 
Because of the nature of the correlation coefficient, the 
high correlations among TQPR's shown in the previous tables 
do not mean that the average TQPR's in quarters one or two 
equalled the TQPR's in, say, quarters five, six, or seven 
(Guilford, 1965, p. 101). Therefore, an investigation was 
made to determine the pattern of average TQPR's over the 
successive quarters in a curriculum. The following tables 
display some TQPR averages from three NPS curricula. 

Table VII shows the average TQPR's earned by two 
different inputs (January and July 1973) to the Management 
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Table VII. 



Three Quarter Longitudinal Study of 
Management Students' Quarterly QPRsl 



Quarter of Curriculum 





Section 




1 


1 _ 


3 


Jan 1973 
Input 


1 (N=20) 


Me an 


3.38 


3.38 


3.45 


Std. Dev. 


.27 


.36 


. 27 




2 (N=23) 


Mean 


3.20 


3.22 


3.33 






Std. Dev. 


. 39 


.39 


.34 




3 (N=22) 


Mean 


3.36 


3.40 


3.44 






Std. Dev. 


.27 


.26 


.23 


Overall Mean 




3.30 


3.33 


3.40 


July 1973 
Input 


1 (N=18) 


Mean 


3.32 


3.35 


3.38 


Std. Dev. 


. 39 


.36 


.34 




2 (N=16) 


Mean 


3.38 


3.38 


3.42 






Std. Dev. 


.31 


. 35 


.30 




3 (N=18) 


Mean 


3.32 


3.32 


3.35 






Std. Dev. 


.38 


.39 


.35 


Overall Mean 




3.34 


3.34 


3.38 


^As the July 1973 input 


had only completed three quarters. 


comparisons 


could only 


be made for 


those three 


quarters 


• 



Data were from NPS records. 



curriculum. Each of these two inputs xvas divided into three 
administrative sections. The student sections are formed in 
a stratified- random procedure, i^ith military ranks defining 
the strata. 

The data in Table VII sho^^^ that the differences among 
the means of the three sections in' the same input tend to be 
larger than the differences betx^een the overall means of the 
txtfo inputs. Further, each of the six sections received 
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higher QPR's in their third quarter than they did in their 
first quarter. 

Rather than risk conclusions concerning issues such 
as "grade creep" based upon only the data in Table VII, 
analyses were made o£ the grade averages in several other 
curricula, as reported in Table VIII. 

The reader should recall that the data in Table VIII 
are from a cross-sectional sampling. Because of this, one 
cannot know for sure whether or not the differences among 
the TQPR statistics in a curriculum are due to differences 
among the inputs into the curriculum and/or due to changes 
in the courses, standards, etc., within the curriculum. 

Given the differences among the TQPR's of the management sec- 
tions shown in Table VII, the differences among the mean 
TQPR's for a given curriculum in Table VIII do not appear to 
be larger than might be expected to occur by chance. (The 
possible exception to this assertion is in the Computer 
Science curriculum, where two mean TQPR's differ by .22, 
but one of the means was computed from a sample of only 
three.) Based upon these considerations and the data shown 
in the preceding tables, the decision was made to standard 
score the TQPR's for each input into each curriculum. Through 
this process, the distribution of TQPR's for individuals in 
the same input to the same curriculum was converted to a mean 
of zero and a standard deviation of one. Thus, the standard- 
ization process yielded equal TQPR means and standard devia- 
tions for all of the inputs and curricula. For some of the 
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Cross Sectional Study o£ Grade Averages (TQPR's) in Several NPS Curricula 
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analyses reported in later parts of this thesis, the grade 
distribution for each input curriculum group was dichotomized 
at the median, with the high group being coded "2" and the 
low group being coded "1." 

2 . Satisfaction 

The officer/student's satisfaction with his area of 
study was considered as being as important a criterion as 
TQPR. From the individual officer/student's point of view, 
satisfaction is of obvious importance. From the U.S. Navy’s 
point of view, satisfaction with an area of study is impor- 
tant because it relates to the officer's desire to use his 
education in "payback" billets. These billets, called P- 
and D-coded billets (SECNAVINST15 20 . 4A) , are considered by 
the Navy as requiring an incumbent having graduate education 
for optimal performance of the tasks in the billet. 

The assessment of an officer/student's satisfaction 
was made by means of the individual's responses to four ques- 
tions buried within a biographical inventory administered to 
the officer/students in the sample. These were items 47, 55, 
59, and 60 in the biographical inventory. Restatements of 
these items are given below. 

47. Do you wish to serve in a billet requiring 
the education that you would receive at a 
graduate school (P-coded billet) ?2 

55. Are you satisfied with your education at 
the Naval Postgraduate School? 



2 

The wording of this item reflects the fact that in later 
studies it will be administered to officers before they are 
selected for a graduate curriculum. 
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59. Do you now like your degree curriculum? 

60. Would you choose a different degree curric- 
ulum if you could start over again? 

Responses to the four items were either "yes" or "no". "Yes" 

responses to items 47, 55, and 59 were scored as plus ones, 

while "no" responses to these items were scored as zeroes. 

"Yes" responses to item 60 were scored as zeroes, while "no" 

responses were scored as a plus one. The intercorrelations 

among the four items and the total satisfaction score were 

computed and examined. See Table IX. 

The patterns of intercorrelations among the four 
satisfaction items and the total score indicated that a total 
score could reasonably be generated by summing an individual's 
0,1 scores for the four items. This procedure yielded total 
satisfaction scores of zero through four. The internal con- 
sistency reliability of these total satisfaction scores was 
estimated using a method described in Gulliksen (1950, p. 

225). This method, according to Gulliksen, provides the 
lower-bound estimate of the reliability of the set of total 
satisfaction scores. These reliabilities are given in Table 
X, and show that the percentage of error variance ranges from 
22 to 35 (Gulliksen, p. 26). As the reliability estimates 
are lower bound estimates, the sets of total satisfaction 
scores seem to be reliable enough to justify their use as 
criteria -- although there is obviously room for improvement. 
The set of satisfaction items should be increased in number 
in future research in order to increase the reliabilities of 
the total satisfaction scores. 
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Table IX. 



Intercorrelations Among the Four Satisfaction Items and Total 
Satisfaction Scores for Several Curricula 

Com Mgt (620) , N = 42 













I terns 






Total 


Sat . 


47 


55 


59 


60 


Total 


Satisfaction X 




.63 


.69 


. 89 


. 78 


Item 


47 




X 


.14 


.41 


.45 


I tern 


55 






X 


. 55 


.25 


Item 


59 








X 


. 66 


Item 


60 










X 




Management 


(#817) 


, N 


= 71 






Total 


Satisfaction X 




.60 


. 77 


.84 


.60 


Item 


47 




X 


.31 


. 29 


.19 


Item 


55 






X 


.58 


.14 


I tern 


59 








X 


.48 


I tern 


60 










X 




AeroEng (#610) , 


N = 


91 






Total 


Satisfaction X 






Not 


Computed 




Item 


47 




X 


.41 


.43 


.21 


I tern 


55 






X 


.62 


.43 


Item 


59 








X 


.67 


Item 


60 










X 



Table X. 

Estimated Internal Consistency Reliability of the Total Sat- 
isfaction Scores for Each of Several Curricula^ 



Curriculum 


Reliability 


N 


ComMgt 


(#620) 


.73 


42 


AeroEng 


(#610) 


.78 


61 


Management 


(#817) 


.65 


71 


OR/SA 


(#360) 


.77 


74 



^These are lower-bound estimates of the reliabilities. 
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Table XI displays the frequency distribution of the 
total satisfaction scores for each of the curricula input 
groups. 



Table XI. 

Frequency Distributions of the Total Satisfaction 
Scores of the Curricular Input Groups 
(All Data are Cross Sectional)! 

OpsRes . /SysAnal . (Curriculum #360) 



Satisfaction 

Score 

4 

3 

2 

1 

0 

Totals 



Quarter II 

16 

2 

1 

3 

23 



Quarter IV 

14 

7 

0 

0 

_0 

21 



Quarter VI 

21 

4 

1 

2 

_2 

30 N=74 



Comp. Sys , Mgt . (Curriculum #367) 



Satisfaction 

Score 



Quarter I 



Quarter III 



4 

3 

2 

1 

0 

Totals 



15 

5 

1 

2 

25 



7 

9 

4 

2 

23 



N=48 



Computer Science (Curriculum #368) 



Satisfaction 

Score 

4 

3 

2 

1 

0 

Totals 



Quarter I 

3 

6 

1 

2 

14 



Quarter III Quarter V 



2 

1 

0 

0 

0 

3 



2 

2 

1 

1 

0 _ 

6 



AeroEng. (Curriculum #610) 



Satis faction 
. Score 

4 

3 

2 

1 

0 



4 

9 

1 

4 

4 



5 

2 

2 

0 

3 



9 

5 

3 

1 

2 



10 

3 

3 

4 
3 



N=23 



Qtr. I Qtr. Ill Qtr. V Qtr. VII Qtr. IX 



9 

2 

0 

0 

0 
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AeroEng. (Curriculum #610) continued from Table XI. 



Totals 22 12 



Com. Mgt. (Curriculum #620) 
Satisfaction 

Score Quarter I 



4 6 

3 4 

2 0 

1 2 

i _0 

Totals 12 



20 23 11 

N=88 



Quarter III 

8 

5 

1 

0 

■ 2 

IF 



Quarter V 

8 

1 

3 

1 

1 

14 N=42 



Sys . Acq. Mgt. (Curriculum #816) 
Satisfaction 

Score Quarter I 



4 

3 

2 

1 

Totals 

Management (Curri 

Satisfaction 

Score 



10 

4 

2 

2 

20 

culum #817 



Quarter 



I 



4 9 

3 1 

2 0 

1 3 

0 _0 

Totals 13 



Quarter III 

9 

4 

1 

0 

15 



Quarter II 

22 

9 

11 

2 

_1 

45 



Quarter V 

2 

8 

3 

3 

_1 

17 N=52 



Quarter IV 

20 

6 

4 

6 

_0 

36 N=94 



The reader is urged to note that the data in Table 
XI do not represent the results of a longitudinal study of 
satisfaction. Until longitudinal satisfaction data have been 
collected, the practical significance of some of the patterns 
in Table XI cannot be known, as differences between quarter 
groups in a curriculum could be due to differences among 
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officer/students and/or "caused" by the ongoing educational 
experiences of the officer/students. 

The frequency distributions of the total satisfac- 
tion scores make one point rather clear: the satisfaction 

scores had a ceiling that was too low. In some curricula, 
e.g., OR/SA, the preponderance of the total satisfaction 
scores were fours. If additional items had been included 
in the set of items addressing satisfaction, a less skewed 
distribution of total satisfaction scores might have result- 
ed. The practical importance of obtaining a less skewed dis- 
tribution is multifold, as officer/students who were "really" 
different in their levels of satisfaction would be less 
likely to receive the same total satisfaction scores, and as 
the usual correlational measure, the product-moment correla- 
tion, is restricted in magnitude when distributions are non- 
symmetric (Caroll, p. 349). Future research on the satisfaction 
of officer/students should utilize a revised total satisfac- 
tion scale. 

The other preliminary analyses were made using the 
total satisfaction scores. First, the correlations between 
the total satisfaction scores and the standardized TQPR's 
were computed for several of the curricula. These correla- 
tions are shown in Table XII. Second, the distributions of 
total satisfaction scores from the different curricula were 
compared. 

The correlations sho\im in Table XII vary consider- 
ably; from essentially zero in Management to .33 in the OR/SA 
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Table XII. 



Correlations Between Standardized TQPR's 
and Total Satisfaction Scores for 
Several Curricula 



Curriculum 


N 


Correlation Between 
and Satisfaction 


ComMgt 


(#620) 


42 


.13 


Aero Eng 


(#610) 


91 


. 24 


Mgt 


(#817) 


71 


.037 


OR/SA 


(#360) 


74 


. 33 



curriculum. Another way to consider these correlations is to 

say that in Management one cannot predict TQPR from satisfac- 

2 

tion, or vice versa, but about 11 % (=(.33)) x 100) of the 
variance in TQPR can be predicted (with a linear model) from 
satisfaction, or vice versa. In sum, the criteria of satis- 
faction and TQPR appear to be relatively independent of one 
another . 

The total satisfaction score distributions from the 
seven curricula for which these scores were available were 
contrasted with one another. Before making these compari- 
sons, the data from the different quarter groups in a cur- 
riculum were aggregated. The Kolomogorov-Smirnof f two 
sample test was used to make the comparisons, rather than 
using an analysis of variance because of the skewed distri- 
butions and unequal sample sizes (Siegel, pp . 127-136). The 
results of these tests are shown in Table XIII. 
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Kolomogorov-Smirnoff Values for Tests of the 
Differences Between Pairs of Total Satisfaction 
Score Distributions 
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As shown in Table XIII, only two of the 21 K-S tests 



were statistically significant at the .01 level. (Because 
of the number of comparisons, the relatively conservative 
.01 level was chosen.) Both of these statistically signi- 
ficant comparisons involved the OR/SA curriculum- -with the 
other curricula being Aero. Eng. and Computer Science. An 
inspection of the cumulative frequency distributions showed 
that the OR/SA distribution contained a greater proportion 
of scores equal to four (the highest satisfaction score 
possible) than did the other two distributions. 

Prior to using the set of satisfaction scores from 
a curriculum as a criterion to be predicted using the SVIB, 
the total satisfaction scores from each curriculum input 
group were dichotomized. Although it was desired to split 
each group at the median of its total satisfaction score 
distribution, it was not possible to do so in many cases due 
to the skewness of those distributions. When it was not possible 
to split the distribution at the median, the split was made 
between satisfaction scores, but as near the median as pos- 
sible. Table XIV documents the way the various total satis- 
faction score distributions were split. (Table XI contains 
the original distributions.) 

The dichotomized total satisfaction scores were then 
recoded ”1" or "2” for the low and high groups, respectively. 
These recoded scores were used as criterion data in some of 
the analyses using the SVIB as a predictor of satisfaction. 
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Table XIV. 



High-Low Total Satisfaction Group Sizes for 
Seven Curricula - Data in Table 
are Numbers of Officer/Students 



Aero. Eng. 


Qtr . 


I 


Qtr . I 


Hi 


13 




7 


Low 


9 




5 


Computer Science 


Qtr . 


I 


Hi 




9 




Low 




5 




Management 




Qtrs 


. I 


Hi 




9 




Low 




4 




Comp . Sys . 


Management 


Qtr. 


Hi 






15 


Low 






10 



II Qtr. 


V Qtr. VII 


Qtr. IX 


9 


13 


9 


11 


10 


2 


Qtr. Ill 


Qtr. V 




2 


2 




1 


4 




Qtr. II 


Qtr. IV 




22 


20 




23 


16 




I Qtr 


. Ill 





16 

7 



Communications Management Qtr. I 



Qrt. Ill Qtr. V 



Hi 

Low 



6 8 8 
6 8 6 



Sys . Acq. Mgt . 



Qtr. I Qtr. Ill Qtr. V 



Hi 

Low 



10 9 10 

10 6 7 



Ops. Res. /Sys. Anal. Qtr. II Qtr. IV Qtr. VI 



Hi 

Low 



16 14 21 

7 7 9 
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B. ANALYSES USING SVIB OCCUPATIONAL SCALE SCORES TO PREDICT 

TQPR AND SATISFACTION 

Stepwise multiple regression procedures were used in an 
effort to predict TQPR from scores on the SVIB occupational 
scales. The Statistical Package for the Scoial Sciences 
(SPSS) (Nie, et. at.') multiple regression program was used 
for these analyses. 

1 . Dichotomized TQPR as a Criterion 

Multiple regression equations were formed separately 
for the Management, CS/Aero, and OR/SA developmental groups 
(see Table III for the sample sizes) using the SPSS stepwise 
multiple regression program. These runs can be summarized 
rather tersely: all of the multiple correlations looked 

promising in the developmental samples, but collapsed in 
the crossvalidation runs. The crossvalidations, which allow 
an estimate of the mean square error of a sample regression 
equation in the population (Darlington, p. 174), indicated 
that the equations would not be useful for BuPers when mak- 
ing predictions of TQPR. 

2 . Standardized TQPR as a Criterion 

As was described earlier in this thesis (see page 
25), the distribution of TQPR's for the officer/students in 
each curriculum and quarter group was standardized to a mean 
of zero and standard deviation of one. These standardized 
distributions were then combined for the developmental groups 
described in Table III, and the combined standardized TQPR 
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distributions used as criterion information in multiple re- 
gression analyses with the SVIB occupational scale scores 
as predictors . 

3 . Computer Science and Aero Eng 

Earlier in this thesis, it was mentioned that the 
data from the CS and Aero curricula had been aggregated be- 
cause of the high intercorrelation between their mean oc- 
cupational score SVIB profile. Hence, one of the multiple 
regression runs investigated whether or not the standardized 
TQPR's in this aggregated sample could be predicted using 
the SVIB occupational scales. The standardized TQPR’s 
could not be predicted, as the cross validation collapsed 
(the multiple R in the crossvalidation group was near zero) . 

In another attempt to develop an equation useful in 
predicting standardized TQPR's, the data from CS students 
were removed and a multiple regression analysis made using 
only data from the Aero Eng officer/students. 

4 . Aero Eng 

Stepwise multiple regression was used to locate and 
weight SVIB occupational scales predictive of Aero Eng TQPR, 
and the resulting equation was then crossvalidated. This 
analysis yielded a very simple model which held up fairly 
well under crossvalidation. Table XV shows the relevant 
data. 

The crossvalidated correlation of .26 in Table XV 
would be significant at a type I error level of .087. The 
correlation is hardly huge, but it could prove useful to 
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Table XV. 



Prediction of Aero Eng TQPR 
from SVIB Occupational 
Scale Scores 



SVIB 

PREDICTOR DEVELOPMENTAL DEVELOPMENTAL X-VAL X-VAL 

SCALE R N R B CONSTANT N 



Forest 

Service .40 89 .26 -.048 1.333 29 



BuPers. Figures 1 and 2 are expectancy charts, which are help- 
ful in understanding the usefulness of this correlation (Lawshe, 
et. at.') . 

Individual expectancy charts are particularly helpful 
for the individual officer considering whether or not to at- 
tend a curriculum such as Aero Eng, because he can be provided 
an estimate of his probability of attaining an above average 
TQPR in that curriculum. The institution, say the Bureau of 
Personnel, can better use Figure 2, as it shows the percent- 
age of officers who can be expected to attain grades above 
the median grade if they choose the top "XV of the officers 
according to the predictor scores. 

In one sense, it is obviously impossible to select 
officer/students such that more than 501 of them will re- 
ceive grades above the median, because the median is the point 
above, and below, which 50% of the scores fall. It is pos- 
sible, however, to select officer/students who will perform 
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above the median grade in the current sample (a grade of 
about 3.16). An assumption being made here is that pro- 
fessors have some absolute standards in mind, and do not 
merely grade students relative to one another. Unless this 
assumption is true, the officer/students will all have to be 
equally excellent students so that the professors cannot 
grade them using the "curve”, or the officer/students will 
find the curve has simply moved upward and the median grade 
will still be far less than an "A". 

Figures 3 and 4 are the expectancy charts for pre- 
dicting Aero Eng TQPR in a form more useful for BuPers . 

The predicted TQPR's utilized in Figures 3 and 4 are computed 
from the equation given in Table XVI and mapped on the "raw" 
TQPR scale. ^ 

. 5 . Management Curricula 

The stepwise multiple regression procedure was used 
to attempt to develop an equation using SVIB occupational 
scales as predictors of standardized TQPR. An equation using 
three SVIB occupational scales yielded a crossvalidated R of 
.23, which, with a sample size of 50, is significant at the 
.021 level. (The reader should refer to Table III for the 
curi'icula represented in this part of the analysis.) 



3 

Predicted TQPR's were computed using the mean and stan- 
dard deviation of the QPRs predicted along with the mean 
and standard deviation of the "raw" TQPR's for the cross- 
validation sample (See McNemar, p. 38). 
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Table XVI. 



Prediction of Management Curricula Standardized 
TQPR from SVIB Occupational Scales 



SVIB Scale 
Artist 


Weight 

(B) 

- .022 


Constant 


X Val R 


X Val N 


Air Force Officer 
Computer Programmer 


- .036 
.047 


. 360 


. 26 


60 



Figures 5 and 6 are expectancy charts helpful in 
using the obtained relationship in predicting Management 
TQPR * s . ^ 

6 . Ops Res/Sys Analysis Curriculum 

Using three of the SVIB occupational scales, a cross- 
validation multiple R of .39 was obtained. Table XVII con- 
tains the data for this equation. 

Figures 7 and 8 are expectancy tables which can be 
used in predicting TQPR's in theOR/SA curriculum.^ 
a. Satisfaction As a Criterion 

All of the stepwise multiple regression analyses 
that were run, with satisfaction as a criterion and SVIB oc- 
cupational scale scores as predictors, failed to hold-up under 
crossvalidation. 



^To compute predicted "raw" TQPR's, the following equa- 
tion 'was used (McNemar , p. 38): 

TQPR Pred. = 1 . 0762 (. 360- . 038 x Air Force Score -.022 x Artist 
+ .047 X Computer Programmer) + 3.143. 

^The following equation was used to compute predicted raw 
TQPR's: TQPR Pred. = .4509(-2.870 + .052 x Psych. - .014 x 

YMCA + .051 X CPA) + 3.3248. 

41 



Table XVII. 



Prediction of OR/SA Standardized 
TQPR from SVIB Occupational 
Scales 



SVIB Scale 


Weight 

(B) 


Constant X Val R 


Psychologist 


. 052 


-2.870 .39 


YMCA Secretary 


- .014 




Senior CPA 


.051 





The prediction of satisfaction will therefore 
have to be done in some other way, perhaps beginning with an 
expanded number of satisfaction-related questions in the 
biographical questionnaire (see pages 27 and 28) . 
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FIGURE 1. 



Aero Eng Individual Expectancy Chart for 
Predicting TQPR Using SVIB as the Predictor 



Predictor 

Score 

Distribution 

Category 



Top 20% 
Next 20% 

Next 20% 
Next 20% 
Bottom 20% 




Probability of Attaining 
Above Median TQPR 



. Figure 2'. 

Aero Eng Institutional Expectancy Chart 
for Predicting TQPR 
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Figure 3.; 



Aero Eng Individual Expectancy Chart: 
Predicted TQPR vs. Probability of Attaining 
An Above Median TQPR 



3.38 to 4.00 
3.28 to 3.375 

Predicted 

3.148 to 3.275 

Cat ego ry 

3-070 to 3.1475 
. <3.0695 to 3.0695 




Probability of Attaining 
Above Median TQPR 



Figure 4. 



Aero Eng Institutional Expectancy Chart: 
Predicted TQPR vs. Percentage Attaining An Above 

Median TQPR 
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TQPR 

Category 



^ 3.38 
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Figure 5-. 



Management Curricula Individual Expectancy Chart; 
Predicted TQPR vs. Probability of Attaining 
An Above Median TQPR 
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TQPR 

Category 



3.52 to 4.00 
3.38 to 3.51 
3.18 to 3.37 
2.93 to 3.17 
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Probability of Attaining 
Above Median TQPR 



Figure ^6-. 

Management Curricula Institutional Expectancy Chart: 
Predicted TQPR vs. Percentage Attaining An Above 
Median TQPR 
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Category 




Percentage Attaining Above 
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Figure 7 .• 



OR/SA Individual Expectancy Chart: 
Predicted TQPR vs. Probability of Attaining 
An Above Median TQPR 
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Figure 



OR/SA Institutional Expectancy Chart: 
Predicted TQPR vs. Percentage Attaining An Above 

Median TQPR 
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V. CONCLUSIONS 



With the high cost of advanced education, both in terms 
of dollars and time away from operational units, it is 
vitally important that the resources of all descriptions 
available for this education be used as efficiently as pos- 
sible. One way to improve efficiency is to do the best job 
possible of choosing the students. The investigation re- 
ported in the preceeding pages concerns improving that ef- 
ficiency. It is centered on the Strong Vocational Interest 
Blank (SVIB) which has shown some promise in predicting 
academic success in various circumstances and has been used 
by the Navy in several other applications. The Personnel 
Research and Development Center (NPRDC) in San Diego is 
well -acquainted with the SVIB and can easily handle scoring 
of the tests on either an occupational scale basis or an 
item response basis. 

The analysis reported in this paper, indicated some very 
useful relationships between SVIB occupational scales and 
academic performance as indicated by TQPR. A predicted TQPR 
can be computed for a man applying to a given curriculum 
using a simple equation including several scale scores as 
the factors with appropriate weightings. It was found that 
several curricula could be merged to yield larger sample 
sizes because of the high correlations among their scale 
scores. This was possible with the regular management, CSM, 
SAM, and communications management groups. CS and Aero were 
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merged, also. Several regression runs were made with OR/SA 
merged with management curricula, but results were not 
nearly as good as when the groups were used separately. 

An important aspect of the life of a modern naval of- 
ficer is his satisfaction with his duties and chosen speci- 
alty. Therefore, it is desirable to predict an officer's 
satisfaction with a curriculum and future P- or D- coded 
billets; this enhances career planning for the officer and 
supports the organizational development of the Navy. Un- 
fortunately, this investigation into prediction of satis- 
faction has failed to reveal a useful prediction method 
using the SVIB occupational scales. 
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APPENDIX A 

Standard Means and Standard Standard Deviations .for 
Various Curricula and SVIB Occupational Scales 
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APPENDIX A continued 
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